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The  contents  of  this  report  reflect  the  views  of  Lincoln  Laboratory 
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1.  Introduction 


There  are  many  data  processing  problems  in  which  decisions  must  be 
made,  based  on  noisy  data,  which  do  not  fit  the  well-known  pattern  of  a  binary 
test  between  two  hypotheses.  Instead,  there  are  N  distinct  hypotheses  (N  >2), 
each  of  which  may  be  composite  (i.  e. ,  contain  internal  parameters),  and  an 
algorithm  is  sought  whereby  each  observation,  or  sample,  implies  a  unique 
choice  of  one  of  the  hypotheses.  We  are  not  interested  in  randomized  tests 
or  sequential  tests,  and  the  discussion  is  carried  out  in  the  simple  context  of 
a  finite  -  dimensional  sample  space  with  hypotheses  expressed  in  terms  of 
well-behaved  probability  densities,  each  containing  a  finite  number  of  real 
parameters. 

In  this  note,  we  suggest  a  simple  algorithm  for  multiple-hypothesis 
testing,  based  on  the  maximum -likelihood  technique  for  deciding  between 
hypothesis  pairs.  The  algorithm  is  not  optimum  in  any  sense,  but  has  the 
virtue  that  it  works,  while  possessing  considerable  intuitive  appeal.  The 
procedure  arose  out  of  the  consideration  of  a  particularly  simple,  but 
practical,  problem  which  requires  a  multiple-hypothesis  formulation,  namely 
the  detection  of  interference  in  a  monopulse  direction-finding  system.  This 
problem,  which  arises  in  Air  Traffic  Control  surveillance,  is  discussed 
here  as  an  illustration  of  the  testing  algorithm. 

2.  Multiple-Hypothesis  Testing 

Let  x  represent  a  sample,  i.e.,  a  point  in  a  multidimensional 
observation  space,  from  which  a  decision  must  be  made  among  N  hypotheses, 
Hj  (i  =  1,  ...»  N).  The  decision  rule  must  be  a  decomposition  of  the 
observation  space,  X,  into  N  disjoint  sets,  Dj  (i  =  1  . . . ,  N),  so  that  a 
sample  falling  into  implies  the  choice  of  hypothesis  i,  while 

N 
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Hypothesis  is  characterized  by  a  probability  density. 


(x  lo^), 

i.U 

which  contains  a  finite  set  of  parameters,  a.  .  The  i  parameter  set,  0^,  is 
a  point  in  a  finite  dimensional  parameter  space,  A.. 

If  we  had  only  to  decide  between  hypotheses  and  H^,  we  would  follow 
the  generalized  maximum  likelihood  principle,  maximizing  each  probability 
density  over  its  respective  parameters  and  comparing  their  ratio  to  a  thresh¬ 
old.  In  other  words,  we  would  accept  over  H.  whenever 

Sup  f.  {x  j  a.) 

a.  c  A. 

i  i _ 

Sup  f.  (x  |  Ct.) 

a.  €  A. 

J  J 

In  terms  of  the  log  likelihood  functions 

f i  (x)  =  log  Sup  f.  (x  la.)  ,  (2) 

a.  f  A. 
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(1) 


we  write 


T  (i  /  j):  li(x)  -  f  .  (x)>  log  X 


ij 


(3) 


This  expression  is  to  be  read:  "testing  over  H^,  accept  H.  whenever  the 

indicated  inequality  is  true".  If  we  set  the  threshold,  X..,  equal  to  unity,  we 

have  logX. .  =  0,  and  the  test  amounts  to  selecting  the  "most  likely  explanation" 

t  J 

of  the  data.  In  general  we  do  not  use  X„  =  1  because  we  anticipate  the  need 

to  control  the  inevitable  decision-making  errors,  often  in  an  unsymmetrical 
way  between  the  two  hypotheses.  Expression  (3)  can  be  rewritten  in  a  sugges¬ 
tive  way  by  introducing  two  threshold  parameters,  (i .  and  ,  as  follows: 

^  J 
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(4) 


T  (i  /  j):  i.(x)  -ix  >  i  (x)  -H 

J  J 


In  words:  "IT  is  accepted  if  i ^  (x)  exceeds  its  threshold,  by  at  least  as 
much  as  the  amount  by  which  l  ^  (x)  exceeds  its  threshold,  HV.  With  just  two 
hypothesis  ,  only  the  difference, 


(T-Mj  =  logX..  , 


is  relevant,  but  (4)  can  be  generalized  to  the  N  -  hypothesis  case  quite  easily. 

A  threshold,  is  associated  with  each  hypothesis  and  the  "excess",  i.  (x)  -  /Lt 
is  computed;  the  hypothesis  with  the  largest  excess  is. accepted.  A  precise 
definition,  in  which  ambiguities  are  resolved,  is  as  follows. 

For  a  given  sample  let 


M  (x) 


N 

Max 

j=l 


Vx) 


(5a) 


Then, 


M(x)  =  fk  (x)  -  Mk  (5b) 

for  at  least  one  value  of  k.  We  assign  x  to  the  set  D^,  where  k  is  the  smallest 
index  for  which  (5b)  is  true. 

This  algorithm  has  N-l  free  constants,  say 

Hj  -M,  .  j  ■  2.  '\  N, 

which  can  be  chosen  (in  principle)  to  control  N-l  decision  errors.  These  errors 

are  expressed  in  terms  of  the  probability  of  choosing  hL  when  H.  is  true  with 

a.  €  B.,  a  subset  of  A.. 

J  J  J 
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Then  each  point,  x,  is  either  in  R..  or  its  complement,  for  each  distinct  pair, 
(i,  j).  If  x  €  R..,  then  H.  is  "preferred"  over  H.,  and  hence  for  each  poim,  x, 
all  the  pairwise  "preferences"  are  established  by  the  definitions  (6).  The  diffi¬ 
culty  is  that  there  is  no  guarantee  that  one  hypothesis  will  be  preferred  over  all 
others  since  the  transitivity  of  the  preference  relation  is  not  an  automatic 
consequence  of  (6).  This  is  most  easily  seen  for  N  =  3  and  can  be  illustrated 
in  a  two-dimensioi.al  sample  space  as  shown  in  Figure  1. 


Fig,  1.  Preference  regions. 


Each  line  in  Figure  1  represents  a  boundary  defining  a  region  R„  and  its 
complement  for  one  pair  of  the  three  hypotheses  H^,  and  H^,  The  numbers 


indicate  the  preferred  hypothesis  on  either  side  of  the  line. 
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In  this  algorithm,  H.  is  chosen  only  when  every  other  H.  is  rejected 

according  to  a  test  cf  the  type  (3).  It  might  be  thought  that  a  more  general 

algorithm  could  be  developed  by  introducing  N  (N-l)  /  2  constants,  (i>  j), 

^  J 

and  the  corresponding  number  of  regions,  R..,  defined  by 


(*)  >  log  X.j  (i  >  j) 


Then  each  point,  x,  is  either  in  R..  or  its  complement,  for  each  distinct  pair, 

^  J 

(i,  j).  If  x  €  R..i  then  H.  is  "preferred"  over  H;,  and  hence  for  each  point,  x, 

^  J  ^  j 

all  the  pairwise  "preferences"  are  established  by  the  definitions  (6).  The  diffi¬ 
culty  is  that  there  is  no  guarantee  that  one  hypothesis  will  be  preferred  over  all 
others  since  the  transitivity  of  the  preference  relation  is  not  an  automatic 
consequence  of  (6).  This  is  most  easily  seen  for  N  =  3  and  can  be  illustrated 
in  a  two-dimensional  sample  space  as  shown  in  Figure  1. 


Fig.  1.  Preference  regions. 


Each  line  in  Figure  1  represents  a  boundary  defining  a  region  R.j  and  its 
complement  for  one  pair  of  the  three  hypotheses  H^,  and  H^.  The  numbers 
indicate  the  ^referred  hypothesis  on  either  side  of  the  line. 
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In  each  of  the  six  regions,  A,  B,  C,  D,  E  and  F  the  pairwise  preferences 
establish  one  of  the  3!  possible  hierarchies  of  choice,  each  with  a  clear 
"first  choice".  Thus,  in  region  A,  is  preferred  to  and  is  preferred 
to  H.,.  However  ,  in  region  G,  is  preferred  to  H^,  is  preferred  to 
Hy  and  is  preferred  to  Hj,  hence  the  preferences  are  inconsistent  with  no 
clear  choice.  If,  in  Figure  J,  we  interchange  the  numbers  2  and  3  on  the  H^' 
boundary,  then  G  becomes  a  region  of  consistent  preferences  while  C  and 
F  are  not. 

This  situation  will  not  happen  in  our  algorithm  since  a  clear  choice  is 
always  made.  The  boundary  between  Dj  and  is  the  surface  defined  by: 

*  L  (x)  “  Vl  =  i2  M 

while  the  boundary  is  described  by 

*2  (x)  -  M2  ~  {*)  -  M3 

The  intersection  of  these  two  boundaries  is  a  subspace  in  which 

1  j  (x)  *  Mj  =  i  3  <*)  -  4  3 

which  is  contained  in  the  -D^  boundary.  Thus  regions  like  G  in  Figure  1 
do  not  arise. 

3.  The  Monopulse  Data  Editing  Problem 

For  our  purpose,  an  "amplitude-comparison  monopulse  system"  can 
be  modeled  as  an  antenna-receiver  system  in  which  rf  signals  are  derived  from 
each  of  two  effective  antennas  having  coincident  phase  centers.  It  does  not 
matter  whether  the  two  "antennas"  are  realized  by  a  pair  of  horn-terminated 
waveguides  facing  a  single  reflector,  or  by  a  pair  of  feed  networks  connected 
to  the  elements  of  an  array,  so  long  as  the  phase  centers  coincide  and  the 
main-beam  voltage  gains  are  real  {i.  e.  negligible  phase  shift  across  either 
main  beam).  The  two  rf  signals  are  amplified  and  demodulated  to  produce 
two  in-phase  and  two  quadrature  components  of  video,  each  containing  additive 
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Gaussian  noise.  These  four  noise  processes  are  mutually  independent  with 
identical  spectra.  In  the  problem  at  hand,  the  receiver  has  detected  and 
synchronized  its  own  timing  on  the  early  portion  (preamble)  of  an  anticipated 
incident  signal.  The  waveform  is  simple  binary  pulse -amplitude -modulation 
(PAM  OOK).  The  four  video  waveforms  are  sampled  once  at  each  bit  position, 
and  we  are  concerned  with  deciding  among  various  hypotheses  regarding 
the  true  state  of  affairs  on  the  basis  of  one  of  these  four -dimensional  samples* 

A  separate  decision  is  made  for  each  bit  position  in  the  waveform  (A  more 
general  problem,  not  treated  here,  concerns  multiple -hypothesis  testing 
based  on  a  sequence  of  samples  as  one  decision. ) 

Let  the  in-phase  and  quadrature  samples  from  antenna  1  be  combined  as 
the  real  and  imaginary  parts  of  a  complex  observable,  Zj,  and  let  the  corres¬ 
ponding  components  from  antenna  2  be  combined  to  form  Z^  The  pair  (Z^,  Z^) 
represents  our  basic  sample,  and  hypotheses  will  be  formulated  as  probaoility 
densities  in  these  two  complex  variables.  The  sample  (Z^,  Z.J  always  contains 
the  receiver  noise  components  (n^,  which  are  independent,  zero-mean, 

complex  Gaussian  variables,  satisfying 

L  nf  =  0  and  E  In  |2  =  2  CT?  i  *  1,2  (7) 

1  1  cl 

2 

The  nois*  variance,  O  ,  is  fixed  by  the  receiver  characteristics,  and  is  con- 
sidered  known. 

A  signal,  coming  from  a  single  direction  (azimuth),  in  the  main  beam  of 

both  antennas,  will  produce  sample  components,  (A^e^,  A^^),  of  the  same 

phase.  The  phase,)/),  is  essentially  the  rf  phase  of  the  incident  wave  at  the  common 

phase  center  of  the  antennas,  and  the  signal  amplitude,  A.,  is  the  product  of  the 

incident  wave  amplitude  and  the  voltage  gain  of  the  i —  beam  in  the  signal  direction. 

Signal  direction  is  determined  ^  from  an  estimate  of  A  / A^t  but  this  aspect  of 

the  processing  is  not  of  direct  interest  here.  If  there  are  two  signals  in  the  main 

beam,  arriving  from  different  directions,  then  each  will  contribute  sample 

components  of  the  form  just  discussed,  but  each  signal  has  a  different  rf  phase,  and 

the  two  signals  have  unequal  amplitude  ratios,  so  that  the  resultant  sample  com¬ 
ity  it!) 

ponents  must  be  modelled  as  (A  e  1  ,  A_e  2),  where  A,  and  A  are  arbitrary 

1  L.  id 
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positive  constants,  and^  and  ^  are  arbitrary  angle  variables.  The  second 
signal  is  interpreted  either  as  interference  from  another  source,  or  as  off- 
azimuth  multipath  from  the  main  signal.  Obviously,  the  same  model  represents 
the  case  of  three  or  more  main-beam  signals. 

A  final  possibility  is  a  combination  of  one  or  more  signals  arriving  from 
outside  the  main  antenna  beams,  where  the  antenna  gains  are  complex  and  vary 
rapidly  with  angle.  Such  a  combination,  representing  side  and/or  back  lobe 
interference  has  been  modelled  as  Gaussian  noise,  characterized  by  sample 
components  (m^  m^)  which  are  statistically  identical  to  the  receiver  noise 
components,  except  for  their  variance 

E  |m.|2  =  2  i  =  1,  2  (8) 

When  this  interference  is  present  the  total  noise  components  of  the  sample  are 

still  independent,  zero-mean  complex  Gaussian  variables,  characterized  by 

2  2  2 

relations  like  (7),  with  replaced  by  +  c£,  considered  known  (this  assump¬ 
tion  is  discussed  below). 

With  these  models  we  can  distinguish  six  possible  hypotheses,  depending 
upon  the  number  of  main-beam  signals  and  the  presence  or  absence  of  side/back 
lobe  interference.  The  hypotheses  are  defined  in  the  following  table. 


Table  I 
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If  no  main-beam  signals  are  judged  to  be  present,  it  is  assumed  that  the  signal 
information  bit  is  a  "zero".  If  one  or  more  main-beam  signals  are  found,  this 
information  bit  is  assumed  to  be  a  "one".  Interference  is  reported  if  it  appears 
to  be  present  as  side/back  lobe  interference,  or  if  more  than  one  main-lobe 
signal  appears.  The  presence  of  interference  of  either  kind  is  used  to  aid  the 
message  decoding  algorithm,  and  also  to  inhibit  direction-finding  on  the  signal 
(by  means  of  the  amplitude  ratio)  ,  since  a  spurious  value  would  quite  likely  be 
found.  Thus,  the  output  of  the  decision  algorithm  is  an  estimated  information 
bit  and  an  interference  flag  ("one"  is  present),  according  to  Table  II. 


Hypothesis 

Information 

Bit 

Interfcrer  ,e 
_ Flafi-  - 

1 

0 

0 

2 

I 

0 

3 

1 

1 

4 

0 

1 

5 

1 

1 

6 

1 

1 

Table  II 

Note  that  hypotheses  H^*  and  H^»  although  statistically  distinct,  all  lead  to 
the  same  response.  Moveover  ,  it  will  turn  out  that  H-j  and  are  indistin¬ 
guishable  from  the  data,  and  H&  will  later  be  dropped.  anu  H&  must  be  tested 
separately,  even  though  the  resulting  decision  regions,  and  D^,  are  combined 
to  determine  system  response.  The  term  "data  editing",  as  used  here,  refers 
to  the  detection  of  interference  and  the  resulting  use  of  the  interference  flag 
in  decoding  and  direction  finding.  These  latter  topics  are  not  discussed  here, 
and  we  return  to  the  specific  formulation  of  the  multiple -hypothesis  testing 
problem. 
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According  to  our  models,  the  probability  densities  for  the  six  hypotheses 
have  the  forms 


f.  (Zv  Z2|a.)  =  (2 naif2  exp 


-  Li  <21>  Z2K>  i  =  1,2, 

n  2 


£i  <zr  Z2^°i>  = 


2ir  (or  + 


Lf(zi-z2igi>l. 

2  (aZ  +  <4)  j’ 


where 


L1  ^Zl’  Z2^  =  L4  (Zi»  z2)  =  I  +  lZ2 1  (no  parameters) 

(10) 

(Z1,Z2|A1,A 2,<b)  =  L^(Z1>Z2|A1,A 2,il>)  =  |Zj  -  Aiei,fi(2+  |Z2  -  A2ei,'’|2 

l]  (Z1,Z2|A1,A2,^j,  t'*2)  =  L2  (Z1,Z2|A1,A2,«/>1,  ^)  =  |ZL  -A1ei,'l|2+|Z2  ^e^'l 


Since  the  variable  parameters  in  all  cases  are  internal  to  the  functions  L^,  the 

2 

required  maxima  of  the  probability  densities  involve  the  minima  of  the  L^.  Since 
2  2 

Lj  and  involve  no  parameters,  there  is  no  minimization  to  perform,  while 
2  2 

and  can  be  made  equal  to  zero  by  the  parameter  choices 


A.e^i  =  Z.  i  =  1,2 
l  i 
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The  remaining  expression  is 


L2  =  LZ5  =  jz^2  +  |Z2|2  -  ZA^eie^Z^)  -  2A2  Re  (e'^ZJ  +  A2  +  A2 


-i*br 


=  lz,  I2  +  |z2|2  + 


K  • 


-fciv 


Re  (e'^Zj)  2 


Re  (e  WZ1)| 


Re  (e’ll/jZ2) 


From 


we  infer  that 


2  2 
cos  0  =  $  +  £  cos  0 


RMe'^Zj)  2  =  ile'^zj2  +  ^Re  (e'^  Zt)2 

. 


=  il^J2  +  i  Re  (e‘2^  Z2)  . 


Thus 
2  ,  2 


L2  =  L2  =  5  (  |Zj  | 2  +  |Z2 12)  +  ^  -  Re(e'i$Zl) 

-  ^  Re  je^’^Z2  +  Z2)J 


This  expression  is  clearly  minimized  by  the  choice 


J  =  iarg(Z2  +  Z2) 


so  that 


Re 


e’^Z2  ♦  z\) 


-  I  Z'  +  Z2  I 


together  with  the  choices 

A  =  Re(e'“*Z  ) 

/,*  -iJ 

A,  =  Re  (e  lvZ,) 


A2  -  Re(e"i,',Z2) 


h 


Re  (e"l^Z7) 


(ID 


(1-1 
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The  resulting  minimum  is 


Inf  LZ  = 


*  5  “  A, Ls  -  *<lz.l‘  ♦  lz2l‘>  -*!*?♦  Z2| 


at  A. 
i  1 


We  introduce  the  notation 


P  2  lZlt2  +  |Z2I: 


o  ;  Izf  +  z||  . 

and  summarize  our  results  in  the  form  of  log  likelihood  ratios: 


VZ1'Z2>  =  “2  log<2ff  °a>  ‘  “4"  P 

2  °a 


i2<Zi»  Z2J  =  “2  l°g  (2lrcrf) - V  (P  '  Q) 

4a 


*3<zi«  z2>  =  "2  log  (2ira^) 

* 

f4(Zl’  z2}  =  "21°8  2ff<aa  + 


ib(Zv  z2)  =  -2  log  2tr  (a2  +  a*) 


i£)(zl»  =  “2  log  2ir(cr^  +  a^) 

- 


2  ("a  *  i'l 


4<<  +  °b> 


(P  -  Q) 


li 


4.  The  Decision  Regions 

According  to  equations  (5)  in  Section  2,  the  testing  algorithm  involves  the 

differences  (x)  -  /! ^ ,  where  the  are  arbitrary  constants  to  be  assigned 

later.  Thus,  the  constant  terms  in  equations  (14)  can  be  absorbed  into  the  4.. 

In  addition,  the  f  (x)  can  all  be  multiplied  by  a  fixed  constant  without  changing 

the  decision  regions.  We  therefore  ignore  the  log  -  terms  in  (14)  and  multiply 
2 

by  the  factor  (  -2a  ).  The  effect  of  the  minus  sign  is  to  change  from  Max  to  Min 
in  equations  (5),  hence  the  decision  regions  are  based  on 


where 


6  f 

M  (Zj,  Z2)  =  Min  |gj(Zl(Z2)  +  Mj 


«1  Z2>  =  P 

g2(Z1,  z2)  =  i(p-  Q) 


g3  (Zj,  z2)  =  0 


g4<Zl’  Z2>  =  5  p 

85  <Z1'  z2>  ‘5E  <p  -Q> 


g6  *Zl’  Z2*  =  0 


2  x  2 

cr  +  O, 
a _ b 
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The  u^  in  (15)  are  new  arbitrary  constants.  We  can  simplify  things  by  assigning 
those  sample  points  for  which 


MZ1'  Z2>  +  »i  <  h(ZV  Zz>  +  »*k  •  k  *  1 


(18) 


to  region  D^,  and  making  an  arbitrary  assignment  of  points  for  which  two  or 
more  of  the  g^  +  fX ^  are  equal.  These  boundary  points  will  not  contribute  to 
any  integrals  expressing  decision  probabilities  or  errors,  since  the  functions 
gk  are  all  continuous. 

We  note  that  the  sign  of  fi  ^  -  M^  i&  independent  of  the  data  and  hence  one 
of  the  t  vo  hypotheses,  or  H^,  is  always  preferred  over  the  other,  depending 
on  the  choice  of  the  fT.  This  simply  means  that  the  data  cannot  support  a  decision 
between  and  H^>  and  is  nowdropped  from  our  discussion  with  the  understanding 
that  Hj,  as  represented  by  g^  (Z^,  Z^)  +  M3  >  represents  the  composite  case 
of  two  or  more  main  -  beam  signals,  with  or  without  side/back  lobe  interference. 

The  decision  region  for  H.  is  simply  the  intersection  of  the  regions  defined 
by  (18)  for  all  values  of  k  distinct  from  i.  Since  the  gk  (Z^  ,  Z 2)  depend  only 
on  the  quantities  P  and  Q,  these  two  statistics  are  sufficient  for  decision  between 
all  five  hypotheses.  Moreover,  the  regions  defined  by  (18),  expressed  in  the 
(P,  Q)  -  plane,  are  all  half  -  planes,  bounded  by  various  straight  lines.  The 
defining  conditions  are  follows,  in  terms  of  the  coordinates  P  and  Q. 


Hj  is  chosen  if 


P  +  Q  <  2  (m2  -  Mj) 


<  M3  -  Ml  . 
R 


R  -  1  'M4  "1 


(19a) 


(M*  -  M,)  .  and 


(2R-1)  P  +  Q  <r  2R  (M5  -  Mj). 
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is  chosen  if 

P  +  Q  ^  2  (M2  -  Mj)  , 

P  -  Q  <  2  (fi3  -  ji2)  , 

(R  -  2)  P  -  RQ  <  2R  (p4  -  Mz),  and 

p  "  Q  Krh  <m5-m2). 

H^is  chosen  if 


p 

2  "3  -  **!  . 

p  - 

Q  >  2  (n3  -  „2) 

p 

2*l»3  -  «4)  , 

p  - 

Q>  2R((ij  -  M5). 

H4  is  chosen  if 

p  •  r^r  . 

(R  -  2)  p  -  RQ  >  2R  (M4  -  Mz)  , 

p  <  R  (M3  "  M4)  .  and 

P  +  Q  <  2R  {ii5  -  M4). 


(19b) 


(19c) 


(19d) 
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is  chosen  if 


(2R  -  1)  P  +  Q  >  2R  (n5  - 

2R 


P  -  Q  > 


R  “  1  (M  5  “  M2)  . 


P  -  Q  <  2R  (M3  "  M5),  and 
P  +  Q  ;>  2*(y  5  -  m4)  • 


(19e) 


Arbitrary  assignments  of  boundary  points  have  been  made  in  equations  (19) 

which  involve  ten  distinct  straight  lines,  corresponding  to  the  ten  pairs  of 

hypotheses.  P  and  Q  are  inherently  positive,  and  P  >  Q,  by  the  Pythagorean 

inequality,  hence  only  that  portion  of  the  first  quadrant  in  the  (P,  Q)  -  plane 

between  the  P  -  axis  and  the  line  P  =  Q  is  attainable  from  the  data.  Unless 

a  boundary  line  crosses  that  portion,  it  can  have  nc  effect  on  any  decision  region. 

When  parallel  lines  enter  into  the  definition  of  a  decision  region,  only  one  will 

be  effective,  depending  on  the  relative  values  of  the  Thus,  a  considerable 

variety  of  shapes  is  available  for  the  regions  D^,  and  error  probabilities  will 

have  to  be  formulated  and  assigned  in  order  to  choose  among  them. 

Note  that  H,  is  chosen  over  H.  (refer  to  Table  I)  if  P  +  Q  exceeds  a  constant. 

1  1  n\ 

This  is  the  detection  statistic  obtained  by  Hofstetter  and  DeLong'  in  their 

analysis  of  amplitude  -  comparison  monopulse.  Details  may  be  found  in  that 
paper  concerning  the  estimation  of  signal  direction  from  the  parameter  estimates 
given  in  (11)  and  (12),  once  has  been  accepted.  We  see  also  that  is  chosen 
over  the  signal  -  plus  -  interference  hypotheses,  and  Hg,  if  P  “  Q  is  sufficiently 
small.  This  test,  which  is  related  to  a  requirement  that  the  monopulse  beam  out¬ 
puts  be  in  phase,  has  been  obtained  bv  McAulav^  for  H2  against  H5,  and 

DeLong ^  for  H?  against  H3.  An  approximation  to  the  P-Q  test  has  also  been 

(41 

obtained  by  McGarty' 
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The  boundary  lines  and  the  hypothesis  pairs  they  separate  are  the  following: 


(Hr 

H2> 

p 

+  Q  =  2  (m2  -  Mj) 

(20a) 

(«4, 

«5> 

p 

+  Q  =  2R  (m5  -  M4) 

(20b) 

(«2. 

Hj) 

p 

-  Q  =  2(m3-M2) 

(20c) 

(H2, 

Hs> 

p 

Q  =  R~n  ^5  ”  M2* 

(20d) 

<h3, 

H5) 

p 

-  Q  =  2R(m3  -|i5) 

(20e) 

(Hr  H3)  P=M3-M1  (2 Of) 

(Hj,  H4)  P  =  ^Y^4-Hl)  (20g) 

(H3.  H4)  P  =  R(^3-M4)  (20h) 

{Hr  H5)  (2R  -  1)  P  +  Q  =  2R  (M5  -  Mj)  (20i) 

(H2,  H4)  (R-2)  P  -  RQ  =  2RUx4-H2)  ( 2 0 j) 

In  practice,  R  will  be  relatively  large  compared  to  unity,  and  in  this  case  line 

( 2 Oi)  is  nearly  parallel  to  lines  (20f),  (20g)  and  (20h).  Also,  line  ( 2 0 j)  becomes 

nearly  parallel  to  lines  (20c),  (20d)and  (20e).  In  this  limit,  our  testing  regions 

2 

become  insensitive  to  the  assumption  that  cr,  ,  the  interference  power,  is  known. 

b  2  2 

An  interesting  possibility  would  be  to  consider  +  (T^  to  be  another  unknown 
parameter  in  hypotheses  4  and  5.  Returning  to  equation  (14),  we  would  find 
that  the  estimates  of  this  parameter  are  p/4  (on  H^)  and  (P  -Q)/4  (on  H,.),  while 
g4  and  would  be  changed  from  the  expressions  given  in  (16)  to 
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(21) 


g4  *zr  zi)  ~  4  °a  log  p 

g5  (Z1*  Z2^  =  4  log  *P  " 

The  (P,  Q)  -  plane  still  suffices  to  define  the  decision  regions,  but  some  of  the 
boundary  lines  would  no  longer  be  straight. 

Returning  to  equations  (20),  we  note  that  H.,»  and  are  separated  from 
one  another  entirely  by  lines  of  the  form  P  -  Q  =  constant,  while  H^,  and 
are  separated  among  themselves  by  the  value  of  P  alone.  The  presence  of 
a  single  main  -  beam  signal  is  detected  by  the  value  of  P  +  Q,  whether  the  back¬ 
ground  noise  is  receiver  noise  or  random  interference. 

If  two  boundary  lines  intersect,  and  also  have  a  hypothesis  in  common,  such 
as  (20a)  and  (20d)  which  both  involve  then  a  third  boundary  line  must  also 
pass  through  the  intersection,  in  this  case  (20i),  separating  and  (this  can 
be  verified  by  direct  substitution)  This  is  an  extmple  the  phenomenon  discussed 
at  the  end  of  Section  2,  and  many  other  three  -  line  intersections  may  be  anticipated. 
Only  eight  of  the  ten  possible  cases  actually  arise  (corresponding  to  the  ten  possible 
hypothesis  triplets),  however,  because  of  the  parallelism  of  many  of  our  boundary 
lines. 

There  are  many  possibilities  for  the  actual  shapes  of  our  decision  regions, 
depending  upon  the  choice  of  the  In  order  to  give  all  the  boundary  lines  a 
chance  to  traverse  the  attainable  sample  space,  the  right  sides  of  equations  (20a) 
through  (20i)  must  all  be  positive,  since  the  corresponding  left  sides  have  that 
property.  This  results  in  the  inequalities 

“l 

<*5  >*4  >(*, 

which  establishes  an  ordering  between  all  pairs  except  and  ^4-  We  must  also 
order  the  three  sets  of  parallel  lines.;  Thinking  of  R  as  large  compared  to  unity, 
we  assume  further  that 


and 

(22) 

* 
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(23a) 


R(»5-M4)  >  M2  -Mj  . 

R  (M3  -  M5)  >  -  M2  >  (M5  -  M2),  and  (23b) 

R  (M  3  "  M4)  >  M3  -  M  j  >  R?f  (M4  -  (23c) 


These  conditions  are  not  strictly  necessary,  but  are  eminently  reasonable, 
considering  the  relations  (22). 

In  Figure  2  we  give  an  illustration,  consistent  with  inequalities  (22)  and 
(23),  showing  all  ten  lines  and  all  eight  triple  intersections.  The  letters  label¬ 
ling  the  lines  refer  to  equations  (20).  In  Figure  3  we  show  the  resulting  decision 
regions,  obtained  by  application  of  equations  (19).  There  are,  in  effect,  four 
adjustable  constants  in  the  choice  of  the  regions  D„  With  the  assumptions  of 
equations  (23),  they  may  be  taken  to  be  the  (P,  Q)  -  coordinates  of  the  point 
where  D^,  and  meet,  the  distance  from  there  to  the  point  where  D^, 
and  D,.  meet,  and  the  distance  from  this  latter  point  to  the  point  where  D^,  D 4 
and  D,.  meet. 

In  order  to  choose  these  constants  we  must  assign  four  error  probabilities. 
There  is  no  guarantee  that  any  set  of  four  such  probabilities  can  be  attained, 


but  reasonable  compromises  can  probably  be  found  by  1  ri?l  and  error.  It  should 

be  recalled  that  in  our  problem  and  result  in  the  same  system  response, 

hence  and  Dj.  should  be  united  and  thought  of  as  a  single  decision  region.  One 

possible  choice  of  error  probabilities,  each  of  which  should  be  "small",  would  be 

E(2/l),  E(3  +  5/ 1 ) ,  E(3  +  5/4)  and  E(.'  +  5/2),  where  E(i  +  j/k)  stands  for  the 

probability  of  declaring  H.  or  H.  to  be  true  when  H,  is  actually  valid.  E(2/l)  is 

1  J  " 

the  simple  false  -  alarm  probability  if  declaring  an  information  "one"  to  be 
present  (but  interference  absent)  when  only  receiver  noise  is  contained  in  the  data. 
In  the  same  true  situation,  E(3  +  5/ 1 )  is  the  probability  of  falsely  declaring  the 
presence  of  interference  along  with  an  information  "one".  E(3  +  5/4),  which 
probably  cannot  be  made  as  small  as  E(2/l),  to  which  it  is  analogous,  is  the 
probability  of  correctly  recognizing  the  presence  of  side/back  lobe  interference, 


but  falsely  declaring  an  information  "one".  A  bound  must  be  assigned  to  this 

2 

error  for  a  range  of  values  of  0^  ,  or  R.  The  last  error,  E(3  +  5/2),  is  the 
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Fig,  2,  Decision  boundaries 
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probability  of  correctly  recognizing  the  presence  of  an  information  "one",  but 
falsely  flagging  the  presence  of  interference,  hence  casting  doubt  on  the  decoding 
and  rejecting  the  measurement  of  signal  direction.  In  general,  this  probability  wil 
will  depend  on  the  signal  -  to  -  noise  ratio  which  exists  under  H^,  and  E(3  +  5/2) 
will  be  subjected  to  a  bound  over  a  range  of  signal  -  to  -  noise  ratios.  The  nature 
of  these  errors  is  summarized  in  Table  III. 


True  Parameters 

Error 

Type 

Reported  Parameters 

Information 

Interference 

Information 

Interference 

0 

0 

E(2/l) 

1 

0 

0 

0 

E(3  +  5/1) 

1 

1 

0 

1 

E(3  +  5/4) 

1 

1 

1 

0 

E(3  +  5/2) 

1 

1 

Table  III 


The  error  probabilities  are  not  easily  computed.  On  hypotheses  and 
the  probability  density  in  the  (Z^,  Z^)  sample  space  has  the  form 

f  (Zj,  Z2)  =  (2ff  or2)"2  exp  -  (P/2  ff2)  ,  (24) 

2  2  2  2  _2 

where,  according  to  (9) ,  O  =  c^on  and  cr  =  on  H4.  From  (24) 

it  follows  that  the  marginal  probability  density  of  the  statistic  P  is 

£(P)  =  — VexP  "  <p/2  *  <25) 

4  a4 

However  the  joint  marginal  of  P  and  Q  appears  to  be  difficult  to  obtain,  and  the 
regions  of  integration  required  are  awkward  to  work  with. 
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In  the  remaining  case,  E(3  +  5/2),  a  useful  approximate  evaluation  can 
be  made,  as  follows.  We  have 


itfi  i  j/) 

Zj  =  A,e  +  nj  ,  Z2  =  Kf  +  n2 


and  hence 


P  =  Ia/*  +  nj2  +  |A2ei?'J  +  n2l2 
=  A2  +  A2  +  2Re  e  ^'(A^  +  A2n2)j  +  jn^  j2  +  |n2  f2 


Q  =  j(Aj®'*^  +  nj)2  +  (A2eltf'  +  n2)2 1  • 


In  the  expression  for  Q  we  write 


Q  =  |  (Aj  +  e"1^)2  +  (A2  +  e_1,n2)2  | 

=  |  A2  +  A2  +  2  e  ^(A^n^  +  A2n2)  +  e  2i!^(n2  +  n2)  j 
=  (A2  +  A2)  |1  +  Z|  , 


where 


.  j  a  2  2 

A.u,  H  A_n_  n,  +  n- 

2  =  2  e-‘*-U - U-  +  e  2*  -X - 1  • 


We  put 


and  expand: 


A1  +  A2 


Z  =  X  +  iY 


A1  +  A2 


i  +  z|  =  i  +  3  +  ir  + 
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Sma"  ‘°  UI,“y-  ™s  wUl  <*•  **“ 
ge  signal  to  -  noise  ratio,  hence 

°  =  +  A2  +  2  Re  +  A^J 

t  Re  [e‘2V  +  „2}]  2  _  /  r .»  .] 

^  1  2J  A2  +  A?  ,  lC  (Vl  +  A2n2>.> 

1  ^  J 

Thus  p  and  Q  agree  through  first  order,  and  we  can  write 

P'Q  *  Ie'i,tn>|2  +  l«‘‘V  [e'2^  +  n2^  -  _1__  , 

f  ,1  J  A‘+A2  «28> 

*  [e  V,  +  a2„2,]  2+... 


If  we  let 


e  n]  =  u!  +  iVj 


6  n2  *  u2  +  iv2 


P‘Q  =  Ui  +  vf  +  +  v2  -  uj  +  v2.u2  +  2 


If TXf  (Vl  +  V2>  +  '*’ 

.  2  .  2,  (A.v  +  A,v,)2 

-  2<v,  +  v2)  -  2  _J_i 2J1_ 

A1  +  A2 


(AIv2  -  A2v,): 
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(29) 


To  this  order,  we  put 

P  -  Q  =  £ 


where 


1-2  7  a2) 
A1  1  A2 


>A1v2  ‘A2v1> 


Since  v.  and  v~  are  independent  Gaussian  variables  with  mean  zero  and  variance 
2  A  2 

a  ,  £  is  Gaussian,  with  mean  zero,  and  variance 

cL 

E  £  =  -j- i - T  E  (Alv2  -  A^)2  =  2  <j\  (31) 

Ai  +  A2 

Returning  to  E  (3  +  5/2),  we  note  that  the  union  of  regions  and 
is  contained  in  the  set 


P  -  Q  >  '  ^2*  ' 


which  lies  below  line  d  in  Figure  1.  Thus 


E  (3  +  5/2)  <  Prob  U2  *  (M5  "  M2)f 


*  pr°b  (|«I  >[tTT1  <1*5  -  **2»]  iJ 


which  is  a  simple  error  function.  It  is  a  remarkable  fact  that  this  error 
probability  is  insensitive  to  signal  -  to  -  noise  ratio  (provided  the  latter  is 
large). 

If  hypothesis  5  is  true,  and  the  signal  power  is  large  compared  to  the 

total  of  receiver  noise  and  interference  power,  then  equations  (29)  through  (31) 

2  2  2 

remain  valid,  with  or  replaced  by  +  a^,  hence  an  error  function  just  like 
(32)  expresses  the  approximate  probability  of  declaring  or  Hg  when  Hj.  is 
true,*  that  is  the  probability  of  correctly  recognizing  the  presence  of  side/back 
lobe  interference  along  with  a  signal. 

We  have  left  some  loose  ends  in  this  problem,  but  our  intention  was  to 
illustrate  the  general  method  of  multiple  -  hypotheses  testing,  which  appears 
to  have  some  practical  utility. 
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